Quasi-equilibrium in glassy dynamics: an algebraic view 
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Abstract 



We study a chain of identical glassy systems in a constrained equilibrium where each bond of the chain 
is forced to remain at a preassigned distance to the previous one. We apply this description to Mean Field 
Glassy systems in the limit of long chain where each bond is close to the previous one. We show that in specific 
conditions this pseudo-dynamic process can formally describe real relaxational dynamics for long times. In 

S particular, in mean field spin glass models we can recover in this way the equations of Langevin dynamics in 
the long time limit at the dynamical transition temperature and below. We interpret the formal identity as 
an evidence that in these situations the configuration space is explored in a quasi-equilibrium fashion. Our 
general formalism, that relates dynamics to equilibrium, puts slow dynamics in a new perspective and opens 
q . the way to the computation of new dynamical quantities in glassy systems. 



1 Introduction 



, Glassy dynamics is often described as a quasi equilibrium process. Phase space exploration is depicted as walk 
from a metastable state to another, the choice of which for large times is dictated by generalized equilibrium 
conditions. This picture has been used in the past to interpret slow dynamics for liquids and glasses in equi- 
librium and aging conditions [TJ [2] , and more recently for studying dynamical fluctuations in equilibrium terms 
\Q , using constrained Boltzmann-Gibbs measures Theoretical evidence in support of this view comes from the 
emergence of effective temperatures in glassy dynamics [1] , the coincidence of certain static and dynamic quan- 
tities in the long time limit [S] and a detailed analysis of the response properties during aging dynamics pQ. In 
addition, numerical simulations of simple models [5] and realistic systems [B] agree with this picture. 

Despite the appeal of this picture and the many arguments that can be bring to its support, a formal 
description of glassy dynamics in equilibrium terms is missing, with the consequence that many quantities of 
dynamical interest as for example the entropy of the trajectories have not been computed even in the simplest 
■ mean-field models. 

In this note we would like to fill this gap by establishing a general methodology allowing to test the dynamical 
quasi-equilibrium hypothesis at least at the mean field level. To this aim we employ the method of constrained 
equilibrium measure [7] and consider a chain of replicas of the system under study, each one in constrained 
equilibrium with respect to the previous one. Such construction was used for chains of length 2 in [7] and of 
length 3 in [5], as a tool to probe the configuration space of glassy systems. The generalization to an arbitrary 
number L of bonds in the chain was sketched in [5] but no computations based on it were presented. Recently 
it has been suggested that large values of L might be necessary to adiabatically follow metastable states in 
temperature [10) and clarify some anomalies encountered in the L = 2, 3 case. Progress has been made by 
Krzakala and Zdeborova in treating this problem with the cavity method for finite L [12]. We will see that 
the interest of this construction goes much beyond the problem of following states. Here we employ the replica 
method and concentrate on fully connected spin glass models, and show how the L —> oo case relates to slow 
glassy dynamics. 
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2 A Markov Chain of replicas 



Given a physical macroscopic system with configurations labeled by S, S' etc. subject to some Hamiltonian 
H(S), and given a notion of similarity q(S, S') between configurations, we consider a linear chain of t copies such 
that: 

1) the first configuration is chosen with Boltzmann probability at temperature T\ 

P(S 1 ) = ^cxp(-(3 1 H(S 1 )), (1) 

2) for any integer s > 1 the s + 1-th copy is drawn from the Boltzmann-Gibbs measure at temperature T s+ i 
(that may or not depend on s + 1) with a chain constraint that q(S s , S s +i) is fixed to some preassigned values 
C c (s -I- 1, s), namely 

M(S S+1 \S S ) = 1 exp (-p s+1 H(S s+1 )) 6(q(S s , S s+1 ) - C c (s + 1, a)). (2) 

Notice that the conditional probability kernel M for fixed C c (s + 1, s) mathematically defines a Markov chain, 
where the probability of a trajectory is given by 

P(S t ,S t -i,...Si)= n M(S S+1 \S S )P(S 1 ). (3) 

s=l,i-l 

Such a general chain construction was mentioned in [9] , but to our knowledge it has not been employed in actual 
calculations or theories. We will often refer to the chain ([3]) as Boltzmann pseudo-dynamics and we call the 
variables s, etc., times in the following. In order to understand the physical property of the chain, we would like 
to study the free-energy of the "last replica" , 

F(L) = -T L P{St-uS L - i ,...S 1 ))ogZt{S L - 1 ) i (4) 

Si,... ,Sl-i 

as a function of the number of bonds in the chain L. Although this free-energy will be the starting point of our 
analysis, we concentrate in this paper on the properties of the measure ([3]), through mean-field analysis based on 
the replica method. 

As we stated in the introduction, a full analysis has been achieved in the cases L = 2 [7] and L = 3 [8] with 
the purpose of investigating the structure of metastable states and the barrier separating them (in these case 
the temperatures are equal along the chain) and the properties of the metastable states when cooled and the 
temperatures depend on s. It has been recently remarked that in order to explain certain anomalies found for 
L = 2 in the case of different temperatures, the general construction with arbitrary L might be needed [10] . 
Unfortunately, the complexity of the computation strongly increases with total number of steps L involved in the 
Markov chain. In this note we show that simple expressions can be obtained in the limit where the total number 
of steps in the chain goes to infinity: differences along neighboring bonds in the chain become small and time 
becomes continuous. 



3 The replica algebra 

The problem of analyzing the chain ([3]) can be addressed using the replica method starting from the computation 
of the free-energy (j4|). One needs to replicate each of the configuration S s a number of time n(s) in principle 
different for each s and consider at the end the limit n(s) — > 0; the free-energy ^ being associated to the term 
of order n(L) of the resulting expression. We will call the replicas S% with the convention that replica indexes 
associated to the index s run from 1 to n(s). Denoting by Q a ,b(s, u) = q(Sg, S^) the overlap between two replicas 
and S£, the chain constraint reads 

Q aa (s+l,s) = C c {s + l ) s) ) (5) 

in words, all replicas a = 1, n(s + 1) at time s + 1 are constrained to have a fixed overlap C c (s + 1, s) with 
replica number 1 at time s. The constraint ([S]) can be imposed through Lagrange multipliers v{s). In this first 
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paper we will only deal with cases in which the constraints "do not make work" and v(t) = 0, for which we will 
show that remarkable solutions exist. Future work it is planned to deal with the fully constrained case. 

Mean Field Spin Glasses In mean field spin glasses the free-energy is obtained as a saddle point over the 
time-replica matrix order parameter Q a ,b(s, u) = (q(S®, £„)}. As usual, we need an ansatz for the replica matrix 
that allows the analytic continuation to n(s) —> 0. In this paper we are interested to the time structure of the 
matrix and we stick to a replica symmetric ansatz as far as the "a, 6" indexes are concerned. The generalization 
to replica symmetry breaking (RSB) is straightforward and does not pose any particular problem of principle. 
In fact we expect RSB to be crucial in many applications and it will be studied elsewhere. 

The form of the constraint ([5]) , symmetry considerations and the experience gained in [7] and [8] suggests to 
consider matrices Q a ,b{s, u) that for s ^ u depend only on the index a if s < u and depend only on b if u < s. In 
the case of s = u the matrix Q a b(t,t) is assumed to have the usual structure. Such a general scheme can easily 
incorporate Replica Symmetry Breaking and this has been considered in the special cases of L = 2, 3 in [7] and 
[5]. In this paper we will limit ourselves to the replica symmetric case where the most general matrix can take 
the form 

Qa,b(s,u)= C(s,u) + [C(s,u)-C(s,u)]Q > (s-u)5 bA + (6) 
[C(u, s) - C(u, s)]9>(u - s)S a ,i + [C(u, u) - C(u } u)}5 s ,uS a ,b, 

where C(s,u) and C(s,u) are symmetric functions of their arguments. Having defined 0>(s) — 1 if s > and 
zero otherwise. In Ising of spherical models C(u,u) = 1. We prefer not to specify the value of C(u, u) = 1 at this 
level to simplify the analysis of functions of the replica matrix. We remark that the Markov chain structure of 
([3]) implies that in the n(s) —> limit the saddle point equations must have a causal structure, and the equations 
for C(s,u) and C(s,u) should not contain values of the functions at later times. One can see that this causality 
property is respected whenever Q a ,b(s, u) only depends on index a if s < u and on the index b if u < s. 

In this way, for example, the equations for C(l,l) is the usual RS equation for the Edwards-Anderson 
parameter in a single system. We will here consider the so called "annealed cases" where the solution is C(l, 1) = 
but the formalism in not specific to this case. It is reasonable (and consistent with the equations) in the annealed 
case to take C(l, s) = 0, choice that we will adopt in the following. In this paper we concentrate on the structure 
of the saddle-point equations and some physical implications of their solutions, letting the study of the free-energy 
to future work. 

In many models (e.g in the spherical spin glass model or in the Ising Sherrington-Kirkpatrick model near to 
the phase transition^) the only non trivial operation that is needed in order to solve the saddle point equations 
is the product of two replica matrices. This is well studied in the case of the standard hierarchical structure, 
where the matrix is parametrized in terms of a function q(x) |13j . 

We are now interested to find out a simple expression for this product. As we have already mentioned we 
want to study the limit where the discrete time t goes to infinity and the Markov chain collapses onto a Markov 
process. To this end it is convenient to evaluate the product between two matrices Qa and Qb which have the 
structure i.e. they are parametrized in terms of functions C g {s,u) and C g (s,u) with g = A, B respectively. 

It turns out that a good long chain limit L — > oo is obtained if one suppose that C(s,u) tends to continuous 
function of s/L and u/L and for s ^ u and for s, u 1, one has C(s,u) — C(s,u) = 0(1/ L). We therefore 
abandon the discrete time: without causing confusion we change notation and from now on the variables u, s, 
etc. will denote continuous variables taking values in some interval [0,t max ], (without necessarily normalizing 
the final point to t max to 1). We then define the function 

T u R(s,u) du = 0(s - u){C{s,u) - C{s,u)). (7) 

that we call response function, we will see later that this name is non-abusive. 

Denoting therefore by Qc the product between Qa and Qb, one finds that Qc is consistently parametrized 
by functions Cc{s,u) and Rc(s,u). In the continuous limit a careful computatiord shows that in the limit in 

lr This is true up to the order (T c — T) 10 in an expansion in T c — T! 

2 In fact this computation can be fully automatized implementing the matrix multiplication on an algebraic manipulation software. 
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which all the n(s) go to zero, these functions verify the relations: 



C c (t, r) = f ds C A (t, s)T s R B (r, s)+ f ds T s R A (t, s)C B (r, s) (8) 

Jo Jo 

+ [C A (t,t) - C A (t,t)}C B (t,r) + C A {t,r)[C B (r,r) - C B (r, r)] 
+C A (t,0)C B (r,0), 

Rc{t,r)= I ds R A (t,s)R B (s,r) (9) 

J r 

+(3 r R A (t,r)[C B (r,r) - C B (r,r)] + (3 r [C A (t,t) - C A {t,t)]R B {t,r), 
C c (t,t) = [ dsC A (t,s)T s R B {t,s) + T s R A (t,s)C B {t,s) 



(i 



+C A (t,t)C B (t,t) - C A (t,t)C B (t,t) (10) 
+C A (t,0)C B (t,0). 

(11) 

The alerted reader will recognize the similarity of eq.ns (fTTj) with the convolution of two functions in the super- 
symmetric formalism used in the Langevin relaxational dynamics starting from random initial conditions [14] . 
In that context one defines the supersymmetric correlation function 

Q(t, 9; s, 9') = C(t, s) + 9T t R{s, t) + 9'T s R(t, s), (12) 

where 9 and 9' are (commuting) Grassmanian variables. The convolution between two functions of that type 

Qc(t, 9; s, 9') = J * du d9" Q A (t, 9; u, 9")Q B {u, 9"; s, 9') (13) 

is still a function of the same form with 

C c (t,r)= f dsC A (t,s)T s R B (r,s)+ f ds T s R A (t, s)C B (r, s) (14) 
Jo Jo 

Rc(t,r)= f dsR A (t,s)R B (s,r). 

J r 

We see that our replica product equals the susy one if C(t, 0) = and C(t,t) = C(t,t). In this respect we 
notice that the term containing C(t,0) comes as consequence of choosing the first replica in equilibrium, and 
would disappear if for example T\ — \ oo, or if the memory of the initial condition would be lost. As the 
matter of fact, if one considers Langevin dynamical relaxation starting from an equilibrium initial condition the 
supersymmetric product is modified and that very additional term appears [15] . The other additional term comes 
from a fundamental difference between real dynamics and Boltzmann pseudo-dynamics. In real dynamics, short 
time scales are dominated by fast relaxation processes and one cannot say in any sense that the vicinity of a 
given instantaneous configurations is explored according to the Boltzmann weight. This property can only hold 
on large time scales. By contrast, pseudo-dynamics samples according to Boltzmann by construction. Notice 
that the minimal distance between subsequent bonds in the chain is C(t,t) — C(t,t), which one can expect to 
be macroscopic. In situations where time scale separation occurs, and the fast part of the dynamics is seen as 
instantaneous by the slow one, the additional terms that we find in the replica product exactly coincide with 
the ones that couple the slow part to the dynamics to the fast one in Langevin dynamics. We will see that in 
fact this property implies that the resulting equations have the celebrated property of invariance |16) under time 
reparametrizations t — > h(t) for monotonous functions h(t). 

It is remarkable that the replicas algebra in the limit of continuous time and vanishing n(s) is isomorphic to 
the supersymmetric algebra of the dynamics. In fact, this longly sought isomorphism [T7] roughly reduces to the 
correspondence 

S bA ds 9 (15) 
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and to neglecting systematically terms of order ds 2 . 

Albeit much more complicated, a formula for the the matrix product can be written for finite n(s). The 
resulting structure constitutes a deformation of the susy algebra, whose formal properties would be interesting 
to study. 

Having established the product algebras for the replicas, we segue into the computation of the equations for 
the spherical model. 



4 Spherical £>-spin models 

The replica analysis, as well as the study of dynamics are simplified in mean field spherical models [IS]- In 
these models the spins Si verify the spherical constraint 5Z i=1 Sf — N and the Hamiltonian H(S) is a random 
Gaussian function of the configurations with covariance 



H(S)H(S') = Nf(q(S,S')), (16) 

where the function f(q) is in general chosen to be a polynomial with positive coefficients. We concentrate here 
on functions / leading to "one step" RSB in statics, as for example one finds in the case f(q) = q p with p > 3. 

The replica analysis of the model shows that the replicated free-energy as a function of a generic replica 
matrix can be written as [18] 

~PF[Q] = \ E PsPuf(Qa,b(s^)) + ^TrlogQ-^Trn(Q-C c ), (17) 

a,b,s,u 

where the last term is needed to enforce the constraints ([5]), as announced we consider the case of v(t) = 0, and 
A*a,fc(i, s) — n(t)5t, s 5 a ,b, where fi(t) enforces the spherical constraint at all times. The saddle point equations read 

^f(Qa,b(s, «)) + ~Q-iO>, u) - ^(s)S a , b 5(s - «) = Q. (18) 
In order not to need to invert Q we can just multiply by Q and get 

L n(u) 



^^2^2 PsPuf'{Q a ,b{s, u))Qb, c (u, v) + i<5 a ,fc<5 S: . u - i^(s)Q Q:C (s, v) = 0. (19) 

u=l 6=1 

Inserting (fTTj) we get the equations: 



fi(t)C(t,u)= fit dsf(C(t,s))R(u,s) + /3 t dsf"(C(t,s))R(t,s)C(u,s) 



+PA(f(l) - f'(C(t, t)))C(t, u) + p t p u f(C(t, «))(1 - C(u, u)) (20) 



t 

a i 



(j,(t)R(t,u) = fit f"(C(t,s))R(t,s)dsR(s,u) 

J U 

+fitf"(C(t, u))R(t, u)(l - C(u, «)) + fi t (f'(l) - f'(C(t, t)))R(t, u), 
H(t)= T t + fi 2 t {f{l)-f(C(t,t))C{t,t)) 

+fi t [ ds (f'(C(t,s))R(t,s) + f'(C(t,s))R(t,s)C(t,s)) + fif'(C(t,0))C(t t 0), 



where we used the condition C(t,t) = 1. As announced these equation are for constant fit — fi invariant under 
time reparametrization. Notice that we can in fact use this invariance to chose the dependence of fit on the time. 
These equations and some of their solutions are well known |19l 1201 1211 115] . In fact non-trivial solutions have 
been found in two cases, describing: 

1. The equilibrium alpha relaxation process for constant temperature T — > Td (Td is the dynamical transition 
temperature of the model) [3D]. In this case one chooses the function C(t,s) and R(t,s) to be time 
translation invariant and verifying the fluctuation dissipation relation R(t — s) = fi dC a~ s ^ ■ 
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2. The slow part of aging relaxation starting from a non-equilibrium condition, for T < Td [21| . This situation 
can be achieved in our formalism if we take a very high value of T\ and later a constant temperature T, 
and supposing loss of memory of the initial condition C(t, 0) = 0. One finds then a family of solutions of 
the kind C(t,s) = C(h(s)/h(t)) (if t > s), with the response verifying the modified fluctuation dissipation 
relation R(t, s) = f3x dc £ s) with x G [0, 1]. 

In both cases the dynamics is critical. Indeed marginal stability, physically associated to vanishing of free-energy 
barriers, appears as a necessary condition for having non-trivial solutions where C(t, s) actually depends on time, 
and in last analysis for the equivalence of slow real dynamics and Boltzmann pseudo-dynamics. 



5 The SK model 

The reader may wander at this point if our findings are specific of models where only products and functions of 
the replica matrix elements are important. In this section we will study the Shcrrington-Kirkpatrick model (with 
Ising spins) and show that the equivalence with long time dynamics still holds. The Hamiltonian of the model 
is a Gaussian function as in the previous section with a correlation function specified by (fT6|) with f(q) = q 2 /2 
For simplicity we will consider the case of infinite initial temperature 2\ — > oo and constant temperature T s = T 
for s > 1. We will not include in the analysis a low temperature equilibrium initial condition. Contrary to the 
p-spin case above T sta t this would require replica symmetry breaking, which is not the main emphasis here. 
Quoting from [22| . we write the replicated partition function of the model (up to irrelevant terms) as 

Z Rep = S ,.e-^^^ X([Q ,« 
±i 

C[Q] = e^^fi Qa ^ SaS ", (21) 

{S a } 

where s.p. denotes saddle point over the elements Q a ,p- In our case the indexes a, /? take the form a = (s, o) 
/3 = (u,b) with s,u — 1,...,L, a = l,...,n(s) and b = 1, ...,n(u). The new interesting term with respect to the 
previous analysis is C\Q\, that we write as 

±i 

C[Q] = X! e^ f3T -°^ T '°-< bQa ' b(s ' u)Sa(s)Sb(u) . (22) 

For small Q one can study the development in powers of Q and many results can be straightforward obtained by 
the algebra we have just derived. In the following we will derive compact expressions that goes beyond such an 
expansion. We then substitute (|6l7p . we get for s > u 



u.b 



(J2Sa(s))R{s,u)S 1 (u)du, (23) 



while for s = 



J2 s)Sa(s)S b (s) = (£, Sa(s))C(s, s)(]T S b (s)). (24) 

a^b a b 

Introducing a field ih(s)ds — S"=i CT a( s ) an< ^ ^s conjugate /3h(s), and mixing freely discrete and continuous 
time notation, we rewrite 

C[Q] = I " Y[dh(u)dh(u) exp^-i / ds du ph(s)C(s,u)h(u) - i/3 f du h(u)h(u) 

( „ n(u) \ 

x exp / ds du ih(u)R(u,s)S 1 (s)+J2^ h (u){Si(u) + S a( u )) ■ ( 25 ) 



G 



Notice that the spins S a (u) in replicas a > 1 are decoupled, and can be summed over; resulting in terms of the 
kind (2cosh/i(M))™( tl ^ _1 — > (2 cosh h(u))^ 1 for n(u) — > 0. The final expression is 



- e J n ( 2eoslltf M~)) '" i(, "'""" ) 



{SiW} 

x exp ^— — J ds du f3h(s)C(s,u)h(u) — i/3 J du h(u)h(u) + J ds du ih(u)R(u, s)Si(s)^j . (26) 

Taking into account the first term in (|21[) , one finds the self-consistency equations C(s,u) = (Si(s)Si(u)} and 
T(u)R(s,u)= s -^. 

Our findings have a clear interpretation: in the long chain limit they describe the equilibrium of spins with 
their local field as well as the adiabatic evolution of the field. In fact, we find that local spin and the field are 
related by 

ph(t)S(t) 

p ^^ = 2^my (27) 

while the field is determined by 

h(t) = 77(f) + [ ds R(t,s)S(s), (28) 



where 77(f) is a zero mean Gaussian variable with covariance {r)(t)r)(s)) — C(t,s). The equations are closed 
observing that in the long chain limit, where the dependence of h(t) and i?(f , s) on time is slow, one can 
substitute S(s) in (|28|) with its conditional average from (1271) m(s) — tanhh(s). Our equations provide the long 
time limit of the Eisfeller-Opper equations for the dynamics of the SK model |23j . The same equations are the 
skeleton of the dynamic cavity equations in the long time limit (as discussed in reference |22j , that can be derived 
by a direct analysis in [24]). 

It is well known that in the SK model the dynamical formalism allows to recover many equilibrium quantities 
related to replica symmetry breaking, like e.g. the function q(x) that describes the statistics of pure states [13]. 
In dynamics this quantity is intimately related to the breakdown of fluctuation dissipation theorem |21j and the 
emergence of effective temperatures (4]. Our analysis unambiguously shows that their appearence is associated 
to quasi-equilibrium sampling of phase space. 



6 Perspectives 

In this paper we have formalized the notion that slow glassy dynamics consists in quasi-equilibrium exploration 
of configuration space. Our analysis has been achieved with mean-field models as reference. In the last thirty 
years such models have been a precious guide in forming physical pictures of the glassy behavior of more realistic 
systems, we can then conjecture that the quasi-equilibrium description holds in general for marginally stable 
glassy dynamics. Indeed we think that quasi-equilibrium exploration of phase space is at the heart of the 
emergence modified fluctuation dissipation relations |21j and effective temperatures [4], the equivalence between 
equilibrium and dynamics discussed in [5] and the time reparametrization invariance properties |16) . All these 
properties have been well verified to hold beyond the mean-field level. 

The formalism we have introduced here is very general and open new perspectives in the comprehension of 
glassy dynamics. 

We would like to mention here a few problems where we expect it will lead to relevant progress. First of all 
let us quote some problems where the chain constraints do not make work, in connection with glassy slow time 
dynamics. 

At the most basic level our formalism suggests how to obtain a sensible discretization of dynamic equations 
in the slow time limit. This could be useful in the context of cavity dynamical method for spin models on sparse 
graphs and Bethe lattices, where a direct dynamical approach leads to hard technical difficulties [25]. This opens 
new perspectives for studying dynamical processes on network and network dynamics [26], such as epidemic or 
damage spreading. 
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At a more fundamental level, one can tackle the task of computing dynamical quantities that could not be 
computed in a dynamical approach. For example, the dynamical entropy, which is related to the terms of order 
n(L) of the free-energy. 

The basic property that slow dynamics is a quasi-equilibrium state, suggests to use our pseudo-dynamic 
formalism to study dynamical quantities in cases where a direct dynamic approach is problematic. For example 
we argue that it enables in principle to study slow dynamics (alpha dynamical processes) of liquids, starting from 
equilibrium approaches based on the replica method. A remarkable example is the HNC approximation, where 
one can find equations similar to Mode Coupling Theory, but in the context of a fully consistent theory. Work 
is on the way in this direction |27j . 

On the side of systems with different temperatures, one can use the formalism to follow metastable states 
adiabatically in temperature [10] . A related question concerns the inclusion of replica symmetry breaking effects. 
Finally we would like to mention interpretation questions that are far from be settled, to start with the surprising 
appearance of the dynamical response in a purely thermodynamic setting. 

The other class of problems which can be addressed is the one where the constraints are effective. The chain 
construction constitutes a powerful probe of configuration space. With working constraints one can study free- 
energy barriers among states. The properties of these barriers and whether the barriers of pseudo-dynamics are 
related to the ones of the real dynamics is a question to be investigated. 
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